A New Penalty-Based Criterion for Model Selection in Regularized Nonlinear Models
نویسندگان
چکیده
In this paper we describe a new penalty-based model selection criterion for nonlinear models which is based on the influence of the noise in the fitting. According to Occam’s razor we should seek simpler models over complex ones and optimize the trade-off between model complexity and the accuracy of a model’s description to the training data. An empirical derivation is developed and computer simulations for multilayer perceptron with weight decay regularization are made in order to show the efficiency and robustness of the method in comparison with other well-known criteria for nonlinear systems.
منابع مشابه
Regularized (bridge) logistic regression for variable selection based on ROC criterion
It is well known that the bridge regression (with tuning parameter less or equal to 1) gives asymptotically unbiased estimates of the nonzero regression parameters while shrinking smaller regression parameters to zero to achieve variable selection. Despite advances in the last several decades in developing such regularized regression models, issues regarding the choice of penalty parameter and ...
متن کاملSystem Identification of Nonlinear Autoregressive Models in Monitoring Dengue Infection
This paper proposes system identification on application of nonlinear AR (NAR) based on Artificial Neural Network (ANN) for monitor of dengue infections. In building the model, three selection criteria, i.e. the final prediction error (FPE), Akaike’s Information Criteria (AIC), and Lipschitz number were used. Each of the models is divided into two approaches, which are unregularized approach an...
متن کاملPresentation of quasi-linear piecewise selected models simultaneously with designing of bump-less optimal robust controller for nonlinear vibration control of composite plates
The idea of using quasi-linear piecewise models has been established on the decomposition of complicated nonlinear systems, simultaneously designing with local controllers. Since the proper performance and the final system close loop stability are vital in multi-model controllers designing, the main problem in multi-model controllers is the number of the local models and their position not payi...
متن کاملModel Selection in the Presence of Incidental Parameters
This paper considers model selection of nonlinear panel data models in the presence of incidental parameters. The main interest is in selecting the model that approximates best the structure with the common parameters after concentrating out the incidental parameters. New model selection information criteria are developed, either using the Kullback-Leibler information criterion based on the pro...
متن کاملYoonseok Lee University of Michigan “ Model Selection in the Presence of Incidental Parameters ”
This paper considers model selection of nonlinear panel data models in the presence of incidental parameters (i.e., large-dimensional nuisance parameters). The main interest is in selecting the model that approximates best the structure with the common parameters after concentrating out the incidental parameters. New model selection information criteria are developed that use either the Kullbac...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003